Papers with Llama Instruct models
LLM Bias Detection and Mitigation through the Lens of Desired Distributions (2025.emnlp-main)
Copied to clipboard
| Challenge: | Prior work on bias mitigation has focused on promoting social equality and demographic parity, but less attention has been given to aligning LLM’s outputs to desired distributions. |
| Approach: | They propose a weighted adaptive loss based fine-tuning method that aligns LLM’s gender–profession output distribution with the desired distribution while preserving language modeling capability. |
| Outcome: | The proposed method achieves near-complete mitigation under equality and 30–75% reduction under real-world settings. |